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[0001] ©2003 James W. Wieder. A portion of the disclosure of 

this patent document contains material which is subject to 
copyright protection. The copyright owner has no objec- 
tions to the facsimile reproduction by any one of the 
patent disclosure, as it appears in the Patent and Trade- 
mark Office patent files or records, but otherwise reserves 
all copyright rights whatsoever. This notice applies to the 
software and data described below and to the drawings 
hereto. 

[0002] 

Background of Invention 

[0003] Field of the Invention: 

[0004] This invention relates to the generation of an adaptive 

personalized entertainment experience (comprised of mu- 



sic, music videos, etc) that is customized for each user 
and more particularly to a system and method for provid- 
ing a customized entertainment experience based upon 
capturing a history of user control actions (such as for- 
ward and back) while each composition is playing, in- 
order to automatically adapt the future sequence of com- 
positions for each user. 
[0005] Description of Related Art: 

[0006] Existing methods for entertaining a listener (or viewer) 

with music or music videos (or other entertainment) have 
numerous limitations that result in a less than an ideal 
user experience. 

[0007] a major limitation with broadcast media such as radio and 
television is that the user has no control over the channel 
stream. If the listener does not like the current composi- 
tion, the listeners only option is to change to another sta- 
tion or channel. However, there is typically a limited num- 
ber of alternate channels of music suitable for the user. In 
addition, to switch quickly to a suitable alternative chan- 
nel requires the user to have found and pre-selected the 
alternate channels of interest. When the user does switch 
channels, the new channel will most likely be somewhere 
in the middle of a composition, advertisement or other 



audio presentation. Recently commercial-free radio is be- 
ing offered via satellite radio (e.g., XM Radio) and some 
internet radio stations, but the music is not customized to 
each user. Another major limitation of broadcast is that 
there is no link between the broadcast stream and the 
user's music collection. If the listener does hear a song 
they would like to add to their music collection, they typi- 
cally need to remember the artist, album and song so it 
can be located or acquired at some later time. Often, the 
information needed to acquire a song (artist, album, title, 
etc) is not available at broadcast time when the listener is 
interested in it. 

[0008] a major limitation of purchased albums on media such as 
CD's, DAT, tapes, and DVD's is that the user must expend 
considerable effort to be able to identify what they want 
and then to locate the media at a vendor and then pur- 
chase it. In order to purchase a media, the listener must 
be able to identify the specific album desired by artist and 
album name. Each purchased media may include many 
compositions that the user does not want. Sometimes the 
listener may purchase the wrong album by mistake. Once 
purchased, the listener must provide physical storage for 
the media and then later locate and insert the media to 



playback the compositions. To playback a particular song, 
the user must remember the particular media (e.g., CD) 
the song is located on and then be able to find that spe- 
cific media among perhaps 100's of similar looking media. 
The user must also coordinate and physically transport 
the media between the user's various locations and de- 
vices (e.g. home ,car, portable player, etc). Often, a de- 
sired album's media may not be at the desired user's loca- 
tion. In addition, media players hold only a limited of 
number of media so the user is limited to a playback 
stream from a limited number of albums at any one time. 
For certain locations, such as in an automobile, the locat- 
ing, handing and inserting the media may be a safety dis- 
traction. The order of playback is limited to the composi- 
tion order on the media, the random ordering of the me- 
dia compositions and/or perhaps a playlist the user man- 
ually defines. The media is subject to scratching or other 
physical damage, requiring the user to create backup 
copies or purchase replacement copies. The physical me- 
dia may have a physical lifetime which is much shorter 
then the user's. In addition, due to the rapid rate of tech- 
nological change, vendor support for a given media for- 
mat may be less than the user's lifetime. 



[0009] An emerging technology, is the storage and management 
of the user's music collection on the user's personal com- 
puter (PC). With compression technology (such as MP3 or 
WMA formats), approximately 2500 (near CD quality) 
songs can be stored per 10 Gbyte of hard disc capacity. 
Since PC's with 30 to 100+ Gbyte discs are now commonly 
available, now or in the near future, PC's will have suffi- 
cient capacity to hold a user's full music collection in 
compressed format. The user's collection is typically man- 
aged on the PC by interactive windows driven software, 
which the user must install and learn to use. The user 
must expend a significant effort to build their collection of 
compositions. The user may expend significant effort to 
convert their previously purchased media (such as CD's) 
into suitable compressed files on the PC hard drive. Even 
using high read/write rate drives, such a conversion could 
take 3 to 10 minutes per CD and 5 to 16 hours for a col- 
lection of 100 CD's. The quality of the compressed file is 
determined by the user's ability to operate the compres- 
sion software and select the appropriate compression set- 
tings for each composition. 

[0010] An emerging way of building a music collection on the 
user's PC is the purchase and down load of songs in a 



suitable compressed format across the internet. The ma- 
jor providers of downloadable songs include PressPlay, 
AOL MusicNet, FullAudio MusicNow, and MusicMatch. 
Users use the PC to locate, purchase and download new 
songs over the internet. A major limitation of this ap- 
proach is that the user must be able to identify the artist, 
album and song by name. Disadvantages include that the 
user must manually locate each song within the catalog of 
songs in the providers database, by typically either read- 
ing through an alphabetical list of songs by musical cate- 
gory (genre), artist, album or alternatively by performing a 
search for each song via a search tool. The may have to 
navigate a separate set web pages to locate and download 
the composition. In some cases, a web page may provide 
a short sample of a song which may be heard before pur- 
chasing and downloading the full song. The user may 
have to wait while the download is occurring, in order to 
verify it downloaded correctly. An additional disadvantage 
is that the additional cost of the PC may exceed the cost 
of the user's playback device. In addition, the user must 
learn to use the PC and its software. The user must man- 
age the downloaded composition once it's been down- 
loaded. The user may have to manually create playlists 



and later relocate the user created playlists by the playlist 
name. 

[° 01 1 ] Some user's have built a portion of their collection via 

music piracy and file sharing software, often using peer- 
to-peer networks across the internet. The user faces ethi- 
cal and legal issues. The user faces additional security and 
privacy issues associated with the peer-to-peer networks 
and the associated software such as viruses, worms, spy- 
ware, and stealth software. In addition, the quality of each 
music file is unknown and not guaranteed, since there are 
multiple good, marginal, bad and bogus versions of each 
song out on the network. The user must expend effort to 
locate the artist, album and song. Then, after waiting for 
the download to complete, the user must determine if the 
quality of the downloaded song is acceptable, and begin 
the process again if the quality is insufficient. The quality 
of the pirated song may be well below the quality of the 
original version. 

[0012] Once the collection is built, the user must manage their 
collection of songs on the PC storage device. Using win- 
dows driven software on the PC, the user must manually 
select among the songs in their collection to create one or 
more playlists. In addition, the user must periodically 



back-up their collection on the PC to protect against loss 
due to drive failure, fire, damage or theft. For large collec- 
tions, this is so inconvenient and time consuming, it is of- 
ten not done frequently enough or not done at all, placing 
at risk of loss of all the user's efforts in building their col- 
lection. There are many competing file formats (MP3, 
WMA, AAC, etc), which only operate with certain vendor's 
hardware and/or software. The formats are constantly 
evolving and may have a limited vendor support lifetime. 
The user's collection in a particular format may no longer 
be supported at some point in time, requiring consider- 
able user effort to convert the collection into another sup- 
ported format, if a conversion is even possible. 
[0013] Several new types of music players, including portable 

players, have emerged that are capable of handling com- 
pressed storage formats. The user's collection and 
playlists for these devices are typically managed via inter- 
active windows software on the user's PC. For players with 
limited storage capacity (e.g., SonicBlue Rio MP3 player), 
PC software is used to select a limited portion of the users 
collection, which is then sent to the player's memory over 
a cable or loaded onto memory media or a memory device 
which the user can inserted into the portable player. Some 



recent players (such as Apple's iPod, Creative's Nomad 
Jukebox Zen, or PhatNoise's PhatBox) have large enough 
hard disc storage (10 to 30 Gbyte) to hold a collection of 
up to 2000 to 8000 songs. Some players (e.g., the Apple 
iPod) auto-synchronize with the PC by plugging into a 
high rate interface cable. The PhatBox player, intended for 
installation in automobiles has a removable hard disk car- 
tridge, that attaches to a PC cradle (USB 2.0 cable) for 
content management. The user's collection and the cre- 
ation of user playlists are managed on the PC via interac- 
tive windows based software. 
[0014] Another emerging technology is user customized radio via 
streaming across the internet, such as Yahoo LaunchCast. 
An automatically generated sequence of songs, custom 
selected based on the user's profile, is generated remotely 
at the service providers server. The stream is forwarded to 
the user across the internet to a player application located 
on the user's PC. Each user creates a unique profile using 
an interactive windows application on the PC in-order to 
select music categories and artists the user likes. The user 
also may provide additional profile feedback, while a 
composition is playing or by accessing the user's library, 
to rate each song, album and artist on a rating scale. A 



major disadvantage of LaunchCast is that there is no link 
between the user's radio profile information and the user's 
music collection [i.e., the user's usage-rights (e.g., listen- 
ing-rights) to particular compositions]. Because there is 
no link with the user's listening rights, the LaunchCast 
user does not have the ability to go "backward" or to re- 
peat a song or cause a particular song to played. If the 
user wishes to add a composition that is playing to their 
collection, they are only provided with a link to a web 
page where the CD may be purchased. A disadvantage of 
streaming is the skipping or jumps that occur if the con- 
tinuous virtual bandwidth is interrupted by other network 
traffic. Another disadvantage of streaming is its limited 
tolerance to insufficient network latency, which can result 
in delays in the radio program, especially when the user 
decides to "forward" or "skip" over the currently playing 
song. 

[0015] other interactive internet based streaming services allow 
the user to create a custom playlist or multiple playlists of 
favorites, by selecting each song to include from a catalog 
of compositions provided by the service. A major limita- 
tion is that the user must familiar enough with the com- 
position to be able to identify the artist, album and song 



by name. In addition, the user must expend considerable 
effort to manually locate each song within the catalog of 
songs in the providers database or the user's library, by 
typically either reading through an alphabetical list of 
songs by genre, artist, album or performing a search for 
each song by using a search tool. The user must continu- 
ally and manually update all this as their musical tastes 
change over time. To generate a stream of songs, the user 
may then have to chose a group or order of particular 
songs to form a user's custom playlist. Another limitation, 
is the user does not own the music collection and does 
not own listening rights to the music. In addition, it is not 
integrated to other listening rights the user already has 
purchased. 

[0016] | n some internet services, the user may indicate the rela- 
tive likeablity of each of the songs in their custom playlist. 
Typically, the user manually rates each composition based 
on a scale, such as 1 to 100. Which requires the user to 
manage in their mind the relative rankings of songs by 
rating number so one song has a higher number relative 
to another. In addition, the user must manually change 
their ratings and their playlists as their taste for songs 
changes over time. This typically requires a significant 



amount of visual interaction from the user, often with a PC 
windows based display, which is not suitable while driving 
an automobile or for many other activities. 
[0017] M 0re generally, the above discussion also applies to music 
videos, short films, movies, video programs, television, 
audio versions of books, talks, speeches, voice content, 
lectures, and any other type of composition. In some 
cases, the media formats will differ (DVD's or other for- 
mats instead of CD's), but the limitations discussed are 

generally applicable. 
Summary of Invention 

[0018] The objectives and advantages of this invention include: 

[0019] Provide a simplified way providing a entertainment (e.g., 
music) experience that is customized for each user. 

[0020] Allow the user to experience both different and new mu- 
sic, more easily and at a faster rate. 

[° 021 ] Simplify the process of finding and acquiring a larger vari- 
ety of pleasing music for each user's collection. 

[0022] N 0t require the user to identify and select compositions 
based upon knowledge of the artist's name, album name 
and composition name. 

[° 023 ] Simplify the purchase and delivery of music (and music 



videos) to create a user's collection. 

[0024] Eliminate all user efforts and concerns with backing-up 
and storing their personal collection of music. 

[0025] preserve a user's profile, history and collection even if 
user devices are lost, stolen, broken or destroyed. 

[0026] Eliminate user efforts of knowing, locating or converting 
different file formats for different devices and future de- 
vices. 

[0027] Allow each user's profile, history and collection to be 

available to all the user's devices where ever they are lo- 
cated or used. 

[0028] Eliminate all user efforts and concerns with transferring 
their personal collection of music between all the user's 
various devices. 

[0029] Allow each user's profile, history and collection to be im- 
mediately available to any user device not previously used 
by the user (a new purchase, a friend's, ...). 

[0030] Adapt to each individual user's control actions, represent- 
ing real-time feedback of likes and dislikes of composi- 
tions while they are played. 

[0031] Adapt to changing user tastes for music, such as when a 
user becomes tired of a given composition. 

[0032] utilize the prior experiences of other similar users, to im- 



prove each users experience. 
[0033] Allow aggregate real-time information collected from the 
many users to influence decisions made by the experience 
providers, composition providers and composition cre- 
ators. 

[0034] Provide a simple and intuitive user interface that is similar 
to existing devices that users are already familiar with. 

[0035] Allow users to share a favorite composition or their cur- 
rent list of favorites with each other. 

[0036] Provide such a superior experience and ease of use 

(compared with pirated alternates) that user's will prefer 
to pay for such convenience. 

[0037] 

Brief Description of Drawings 

[0038] FIG. 1 illustrates the capture of user control actions repre- 
senting user feedback about a currently playing composi- 
tion. 

[0039] FIG. 2 illustrates the functional flow between user devices, 
experience providers and composition providers. 

[0040] FIG. 3 is a functional diagram of a personalized music 
player. 

[0041] FIG. 4 illustrates an embodiment of a user interface for a 



user device with manual controls. 
[0042] FIG. 5 illustrates an embodiment of a user history 
database. 

[0043] FIG. 6 illustrates the functional flow of a Real-time Se- 
quence Generator. 

[0044] FIG. 7a illustrates typical graphs of "user likeability or en- 
joyment" versus the "number of times heard". 

[0045] FIG. 7b illustrates typical graphs of "time between plays" 
versus the "number of times heard". 

[0046] FIG. 7c illustrates a typical graph of "time between plays" 
versus "(current enjoyment)/(peak enjoyment)". 

[0047] FIG. 8 illustrates a process for recommending new com- 
positions and new highlights for a user. 

[0048] FIG. 9 illustrates an embodiment of an Aggregate Com- 
mon Likeability Database. 

[0049] FIG. 10 illustrates an alternate embodiment of an Aggre- 
gate Common Likeability Database. 

[0050] FIG. 11 is a flow diagram of one embodiment of an audio 
composition finder. 

[0051] FIG. 12 is function diagram of an embodiment of the user 

usage rights management. 
Detailed Description 

[0052] Distribution of Compositions: 



[0053] Figure 2 illustrates the functional flow between user de- 
vices 21, composition providers 23, experience providers 
26 and usage rights authorities 24 across one or more 
networks 27. 

[0054] As shown in figure 2, there may be a plurality of possible 
users 21 (userl, user2, user"z" ). Each user may oper- 
ate one or more user playback devices 22 at different 
times and different locations. The devices a given user 
operates may be at many different locations, such as at 
home(s), work(s), automobile(s), portable(s), etc. User de- 
vices may also be incorporated into other products such 
as a cell phone, television or home entertainment system. 
The user devices may be mobile and portable. Some de- 
vices (i.e., a personal player) may be used by only a single 
individual user. Other devices (i.e., an automobile player) 
may be operated by different individuals at different 
times. The user devices may be manufactured by a many 
different vendors. Any given user device may only be able 
to handle a limited number of the available composition 
formats. 

[0055] There may be many composition providers 23 that each 
provide their own catalog of compositions for which they 
control the intellectual property rights. A composition 



provider may control the compositions for a single com- 
position creation entity [i.e., the creative artist(s) or group] 
or many composition creation entities. 

[0056] There may also be many different experience providers 
26. An experience provider is responsible for providing 
the adoptive personalized entertainment sequence that is 
customized for each user and is integrated with the user's 
collection of compositions. The experience provider may 
automatically introduce the user to appropriate new com- 
positions over time and automatically adopt the personal- 
ized program sequence as a user's tastes change. The ex- 
perience provider automatically distributes the user's col- 
lection and also automatically collects and maintains the 
user's profile and history across all the user's devices. The 
user's collection is made available to any device the spe- 
cific user is operating. 

[0057] There may also be one or more usage rights authority 24. 
The usage right authority or authorities utilize a common 
"standard for usage rights tokens" 25 so that a user's col- 
lection of compositions, represented by the set of usage 
rights tokens a user acquires, may be recognized and us- 
able with all experience providers. Each usage rights to- 
ken is for use by only a specific individual user. The com- 



positions in a user's collection may be easily transferred 
between and used with any of the experience providers. 
The listening rights authority may also maintain a 
database of all issued tokens so a user's collection (usage 
rights tokens) may be preserved even if all the devices of 
a user were to be lost or damaged. 

[0058] Portions of the network(s) 27 may be wired or wireless. A 
wireless interface between user devices and the network 
may be preferred since the wireless connection may be 
established and maintained more automatically and with 
minimal user efforts. 

[0059] Most users will typically utilize many different players at 
different locations throughout the day and from day- 
to-day such as in different rooms of the home, at differ- 
ent homes, at different work locations, in different auto- 
mobiles, or various portable devices. In addition, there are 
many devices that the user may only temporarily use, such 
as devices located at a hotel, a rental home, a rental car, 
on loan from a friend, etc. It is desired that the user's his- 
tory and profile be interoperable and automatically syn- 
chronized between all these devices so the user history 
collected at each device is available to all other user de- 
vices. An experience provider may automatically perform 



the required level of synchronization between all of the 
user's devices and storage locations on the network(s). 

[0060] | n one embodiment, the user history and user profile in- 
formation is stored redundantly at multiple locations dis- 
tributed across a network(s), such as the internet, so that 
the user's information has a high availability (even if some 
network nodes/paths are down) and is robustly protected 
from loss. Periodic back-up or archiving of the informa- 
tion may also be utilized to provide an additional protec- 
tion against loss of the user's information. In one embodi- 
ment, this storage function is provided by the experience 
provider. Alternatively, a separate storage provider may 
provide storage, backup, archiving and protection of the 
user's history and library on the network. In-order to pro- 
tect user privacy, user information stored on the network 
may be stored in an encrypted form for which the storage 
provider does not hold the decryption keys. Encryption 
mechanisms may be utilized to keep a user's history pri- 
vate and not accessible to human prying. 

[0061] Experience Providers: 

[0062] An experience provider is responsible for providing the 
adoptive personalized music (or entertainment) program 
that is customized for each user and is integrated with the 



user's collection of compositions. The experience provider 
may coordinate the following functions automatically 
without requiring any significant user action: 
[0063] i) provide a sequence of compositions, highlights and 
other material that is customized for each user based 
upon the prior history of user control actions and feed- 
back. 

[0064] 2) Provide copies of compositions, highlights and other 
material to all user devices as needed. 

[0065] 3) Manage, store, backup and make available the user's 
collection so that it is available to all the user's devices. 
The user's collection may be represented by a set of user 
usage rights tokens. 

[0066] 4) Manage, store, backup and update the user's history 
(including control actions, feedback, play history, profile) 
across all the user's devices in-order to adapt to the 
user's changing tastes. 

[0067] 5) Recommend new compositions and highlights likely to 
be appealing to each specific user. Automatically incorpo- 
rate the new compositions and highlights into the user's 
program sequence and the user's collection. 

[0068] 6) Provide pre-customized channels for each user 

(representing different categories, genre or moods of mu- 



sic) that may then be further optimized for each user 
based on user control actions and feedback. 

[0069] 7) Provide additional advertisements, news, or weather 
presentations in the user's program stream that are cus- 
tomized for each user based on user control actions, 
feedback or user profile. 

[0070] 3) Provide software updates for user devices. 

[0071] g) obtain usage rights for compositions that are made 

available to the user. Pay royalties to composition owners 
based on the user's usage. 

[0072] io) Bill users for composition purchases, usage and other 
services. 

[0073] ii) Provide a "capture" mode capability to enable user's to 
identify and later experience and evaluate a composition 
they may be hearing from a non-user device. 

[0074] 12 Provide a "share" mode capability to enable a user to 
share a list of compositions with other users. 

[0075] Although all of the above functions may be performed by 
the user's experience provider, the may performed by 
separate entities that are under the coordination of the 
user's experience provider. It is desirable that the user 
have many experience providers to chose between and to 
be able to easily switch (with low switching costs) from 



one experience provider to another. 

[0076] it is desirable that the user's collection be easily transfer- 
able between experience providers. This may be accom- 
plished with user usage-rights tokens that are issued by 
one or more listening right authorities that are universally 
recognized by all experience providers. This eliminates 
problems with tokens issued by each experience provider 
but which are not recognized by other experience 
providers and hence are not transferable. 

[0077] The experience provider's costs for the library storage and 
management functions may be effectively amortized 
across a large number of users. All transfers of informa- 
tion between the experience providers repository (or de- 
pository) and the user devices may occur automatically 
without requiring any user knowledge or action. Concur- 
rency of user data in the currently active user device(s) 
and the repository occurs automatically across the net- 
work without the user needing to be aware of it or taking 
any action. 

[0078] p r j or to a device shutting down, all the latest user feed- 
back and user history may be forwarded to he network 
repository for later use by other user devices. The device's 
user display may optionally include an indicator, that is 



activated during device shutdown, to indicate whether 
concurrency with the repository has been completed. Op- 
tionally, the device may include a automatic capability of 
periodically trying to establish a network connection for 
upload in-order to complete concurrency with the reposi- 
tory prior to concluding shutdown. 
[0079] it is desirable that user devices be able to operate with in- 
termittent or temporarily unavailable network connec- 
tions. When a network connection is not available, the 
user device may utilize compositions and highlights that 
were previously transferred to the local storage in the de- 
vice. New highlights and new compositions may be limited 
to what was locally stored during previous network con- 
nections. In addition, timely information such as news and 
weather may not be available when the network connec- 
tion is lost. 

[0080] News, weather, traffic, etc may also be customized for the 
user based upon factors such as the day of week, time of 
day, or the location of user. Customization of weather and 
traffic reports to the day of week and time of day. Reports 
may be automatically adapted to the current physical lo- 
cation of the user. 

[0081] since the entertainment program is customized for each 



user, typically only one user program needs to be active at 
any one time. In some cases, the user may want the same 
program to be available at multiple locations, such as in 
multiple rooms in a house. The experience provider may 
impose limitations on the number of simultaneously active 
user devices and/or the maximum physical separation of 
devices that may be simultaneously active. The experience 
provider may monitor for violations which may indicate 
piracy or identity theft by examining the user history. 
[0082] User Device: 

[0083] Figure 3 is a functional diagram of a user device for gen- 
erating an adaptable personalized entertainment experi- 
ence. The user device includes a "user control interface" 
32a for accepting user control actions and for determining 
the individual user (and user ID). The user device may in- 
clude a "user display" 32b for presenting visual informa- 
tion for the current composition or device status. The user 
device also includes "sound generation" capabilities 32c 
or an interface to an external sound generation apparatus 
so the user may hear the customized sequence of compo- 
sitions and other program information. The user device 
includes storage 33 to hold information locally that may 
include: 1) Compositions. 2) New recommendations list(s). 



3) New compositions and highlights. 4) Usage rights 
(tokens). 5) Advertisements, news and/or weather. 6) User 
history 7) Device software and updates. 
[0084] The "network interface" 31 receives information 34 from 
the experience provider and sends information 35 to the 
experience provider. Most transfers to and from the expe- 
rience provider occur automatically without requiring the 
user to specifically initiate them. Information received 34 
may include: 1) Favorite compositions. 2) New recommen- 
dations list(s). 3) New compositions and highlights. 4) Us- 
age-rights tokens. 5) Ads, news and weather. 6) User his- 
tory. 7) Software updates. 8) User feedback validation. In- 
formation sent 35 to the experience provider may include 
the user's history and updates to the user's history. User 
history and updates to user history may include: 1) User 
profile information. 2) User control actions. 3) User feed- 
back. 4) User playback history. 5) User content restric- 
tions. 

[0085] The user device also includes a processor 30. The proces- 
sor performs the user functions such as 1) Sequence Gen- 
eration. 2) User control action (feedback) capture. 3) User 
history capture and update. 4) Experience provider inter- 
face transfers. 



[0086] u ser usage-rights: 

[0087] Rather than ownership of physical media, a user's collec- 
tion may be defined by a set of tokens that define the us- 
age-rights owned by one specific user. A usage-rights to- 
ken may hold the usage-rights (e.g., listening rights for 
musical compositions) for a specific individual user for a 
specific composition. Since the tokens are electronic, the 
usage-rights tokens may be easily shared or distributed 
to all devices that the specific user owns and/or uses. This 
allows the user's collection to be automatically available 
anywhere the user is. If desired, a usage-rights token may 
control a user's usage-rights for a group of compositions, 
such as all the compositions on an artist's album. 

[0088] over time, a user may purchase various usage-rights to 
particular compositions to form their collection. Such 
rights may be for a limited number of plays, unlimited 
number of plays by the user within a certain time frame, 
etc for a given composition. 

[0089] The usage-rights may extend for any period of time 

(start/stop time) or for the user's lifetime or perhaps per- 
petual rights that may be transferred to another user. The 
usage-rights may be limited to a certain number of plays 
or may be for an unlimited number of plays. The usage- 



rights may be limited to certain format(s) or may be valid 
for all formats available. The usage-rights may also ex- 
tend to future formats that may become available due to 
technology advancement. The usage-rights tokens may be 
upgradeable, when desired by the user, to expanded us- 
age-rights. Ideally, the tokens are recognizable by all user 
devices. Based on normal user control actions, new tokens 
may be automatically purchased or acquired on behalf of 
the user and added to the user's collection. 
[0090] The usage-rights token may be separate from the compo- 
sition. As shown in figure 12, the compositions are deliv- 
ered and stored in an encrypted form 124. The encrypted 
token 122 along with user ID/password/biometric infor- 
mation 120c, date/time 120b and "user feedback valida- 
tion" information 120a may be used to decrypt the com- 
position key. The composition key 127 is then used to de- 
crypt the composition 125 to generate the decrypted 
composition 126 for playback to the user. The "user feed- 
back validation" 120a may be encrypted and represent a 
validation that the user has provided regular and consis- 
tent usage and history feedback to the experience 
provider. If appropriate user feedback is not received from 
user device(s), the "user feedback validation" 120a may 



lockout usage of that device(s) until such expected feed- 
back is re-established. The "user feedback validation" 
120a may also include date and time information to check 
against improper settings of the local clock. The "feed- 
back validation" 120a may be used to inhibit user ID 
piracy or inhibit multiple users from using a single user ID 
by preventing an excessive number of user devices from 
being simultaneously operated in widely different physical 
locations. 

[0091] user's may exchange their previously purchased physical 
media such as a CD for usage-rights token(s). The tokens 
may also be optionally transferable between users to allow 
the transfer of any portion of one user's collection to an- 
other individual or upon the user's death. To control 
piracy from extremely short-term exchanges, a limitation 
on the time between such transfers may be imposed. 

[0092] users want the ability to switch experience providers and 
to be able to easily take their listening-rights tokens with 
them from one experience provider to another. Hence, it 
is desirable that the user's usage-rights tokens be recog- 
nized by all experience providers. The usage-rights au- 
thority 24 is responsible for imposing a "standard for us- 
age-rights tokens" 25 that allow them to be portable to all 



experience providers. The usage-rights tokens may be is- 
sued by a usage-rights authority (authorities) 24 that are 
independent of but recognized by all experience 
providers. This allows a user's usage-rights tokens to be 
usable with all experience providers. 
[0093] The usage-rights authority obtains issuing rights from the 
owners of each composition. A secure database of all is- 
sued tokens may be maintained by the token issuing 
rights authority. The tokens may be distributed for use at 
any or all the user's devices and with all experience 
providers. To eliminate user concerns about the loss of 
their tokens (representing their collection), a user's com- 
plete collection of tokens may be recovered by the issuing 
authority by accessing the token database. The user's col- 
lection of tokens may be robustly preserved against loss 
by distributing multiple copies at different physical loca- 
tions across a world-wide network and periodically 
backed-up and archived on the network. In this manner, a 
users collection may be robustly preserved no matter what 
happens to any or all of a user's physical playback de- 
vices. It is preferred that the preservation of user tokens 
be provided automatically by a usage-rights authority, an 
experience provider or a storage provider without requir- 



ing user efforts. 

[0094] The individual user's collection of compositions is repre- 
sented by a collection of the listening right tokens. Ideally, 
the management and handling of the tokens occurs auto- 
matically by the playback devices and does not require 
user action or knowledge. The experience provider may 
automatically manage and backup copies of the user's to- 
kens in-order to eliminate user's concerns about loss of 
their collection. 

[0095] if desired, copies of the tokens may also be kept by users 
in a physical hardcopy form but this is not preferred since 
the user must store and organize such physical entities 
and they must be convertible back into electronic tokens. 

[0096] Identifying the specific user: 

[0097] Each user device must determine the specific user that the 
entertainment program will be customized for. In one em- 
bodiment, each time the device is re-started or powered- 
up the user may be re-determined so that multiple users 
may intermittently share the same device, yet experience 
a customized program. Voice recognition of the user's 
voice or a unique verbal identifier or some combination of 
both may be used. Other possibilities include the recogni- 
tion of the user via an camera image taken at startup, or 



various bio-metric sensing of the user such as fingerprint 
sensor on the "on" control or other device controls. The 
same input microphone may be used for both voice 
recognition and for the optional "capture" mode 
(discussed in a later section). The device may also keep a 
list of prior user's so the identification process may be 
defaulted or biased toward the most recent user(s). For 
devices that are typically used by a only single user, the 
user identity may be configured on initial use and not re- 
configured unless a reconfiguration is specifically re- 
quested by the user. It is preferred that the user identifi- 
cation process require minimal or no specific user actions. 
[0098] Accuracy in identification of the user is important to pre- 
vent corruption of both the user's usage-rights and user 
history due to user identity errors, piracy or identity theft. 
Additionally, since the user's history and usage-rights are 
of considerable value to each user, user "identity theft" 
should be protected against. Methods for identity recovery 
may be employed, so a user's history may be restored to 
the state just prior to the occurrence of an identity theft. 
Software may be utilized by the experience providers to 
monitor for unusual behaviors that are indicative of iden- 
tity theft. 



[0099] ^ is desirable to create a user experience so that it is in 
the user's interest to correctly identify themselves to the 
"system" and to protect themselves against identity theft 
or the loaning of their identity to others. User's will realize 
that the use of their identity by others, will corrupt their 
user feedback history and compromise their customized 
program experience. By providing a customized experi- 
ence and continually providing new compositions that are 
of high value to the user, users will be naturally compelled 
to correctly identify themselves and avoid loaning their 
identity to others. 

[0100] Besides the everyday user ID, a more hidden and secured 
user identity may be maintained by the "system". This al- 
lows the user to re-establish a new everyday ID if their ev- 
eryday user ID becomes compromised. 

[0 1 0 1 ] User Interface: 

[0102] The personalized player may be controlled by the user via 
numerous types of user interfaces including voice acti- 
vated, manual controls, touch screens, interactive dis- 
plays, remote control devices, etc. 

[0103] Fig. 4 shows an example of a manual user interface for 
use where the user is within reach of the controls such as 
with a portable player, a remote control, or a player lo- 



cated in a automobile within reach of the driver. Such 
controls may be implemented with electrical-mechanical 
controls such as push buttons, switches, sliders and 
knobs or with interactive touch screen control. In another 
embodiment, the controls of figure 4 may also be accom- 
plished with voice commands. 

[0104] The "Favorites-New" slider 41 is used to vary the percent- 
age of new compositions that the user will hear. When the 
slider is at the "favorites" position (lowermost position) all 
compositions are selected among those most highly liked 
by the user. When the slider is positioned at the "new" po- 
sition (uppermost position) the user is only exposed to 
new compositions he or she is not familiar with. The user 
may adjust the "Favorites-New" slider position by activat- 
ing (pressing) the "New" 42a and "Favorites" 42b controls 
or in an alternative embodiment by dragging the slider in- 
dicator 41 upward or downward. As the slider 41 is posi- 
tioned further away from "favorites" and closer to "new", 
the user will hear a greater percentage of new composi- 
tions and a lower percentage of favorites. 

[0105] | n another variation, highlight-snippets may be inserted at 
increasing frequency as the position of the "Favorites- 
New" slider is closer to the "new" position. 



[0106] As shown in figure 4, the device may include a display 40 
to indicate information about the selected channel, com- 
position being played (artist, title, etc), playtime, device 
status, etc. The device may also include typical user con- 
trols such as "pause" 42e, "play" 42d, "forward" (or "skip") 
42c, "back" 42f, and channel controls (43a, 43b, 43c and 
43d). 

[0107] | n another optional enhancement, when a sequence of 

user commands indicate user difficulty or frustration, the 
device may issue recommendations to the user on how to 
better utilize the device's capabilities. Such recommenda- 
tions might be issued by voice synthesis or on the device 
display. 

[01 08] Capturing and Utilizing User Control Actions: 

[0109] The user's control actions (control history) from a user's 
various devices may be captured as user feedback about 
the compositions heard by the user. The user control his- 
tory (feedback history) may then be utilized as input for 
the ranking of compositions by likeability and for the cre- 
ation of a customized composition sequence (or enter- 
tainment program) for each individual user. 

[0110] User feedback about each composition when it is playing 
may be obtained based on the user's usage of the "back" 



42f and "forward" 42c ("skip") controls (or the equivalent 
voice controls). For example, a user's composition rating 
may be increased, whenever the user uses the "back" 42f 
control (or a series of "back" controls) to request that a 
recently played composition be repeated. For example, if 
the user uses the "back" control to immediately request 
that the currently playing composition be repeated, the 
user rating for that composition is significantly increased. 
Similarly, if the user uses a series of "back" controls to re- 
quest that a recently played composition be replayed, then 
the user rating of the requested composition is signifi- 
cantly increased. If the user requests that a composition 
be played after searching for the composition in the user's 
favorites list, the user rating for that composition may be 
increased. If the user requests that a specific composition 
be played, the user rating for that composition may be in- 
creased. 

1 ] Similarly, a user's composition rating is decreased, when- 
ever the user uses the "forward" control 42c to request 
that the rest of a currently playing composition is to be 
skipped. The amount the user's composition rating is de- 
creased may be dependent on how much of the composi- 
tion has played before the user activates (presses) the "for- 



ward" control. For example, the rating may be decreased a 
smaller amount if the user skips forward near the end of a 
composition playback. The rating may be decreased a 
larger amount if the user skips "forward" near the begin- 
ning of the composition playback. 
[0112] a user's composition rating may be changed by the "for- 
ward" or "back" controls, only when the composition has 
played for a long enough time for the user to recognize it 
(i.e., the playback time has exceeded a recognition 
threshold time). For example, if the user hits the "back" or 
"forward" control so quickly in a sequence that there is 
not enough time for the intermediate compositions to 
start playing and be heard by the user, then the ratings of 
the intermediately bypassed compositions may not be af- 
fected. 

[0113] An additional method for indicating positive user feed- 
back may be accomplished by a single action by the user, 
such as activating a single control (if manually controlled) 
or the speaking a single word (if voice controlled). For a 
player with manual controls such as in figure 4, a single 
control switch called "Like" 42g (or another suitable name) 
may be pressed by the user while a composition is playing 
in-order to indicate a desire that the composition be 



played more frequently. Optionally, different amounts of 
"like" may be indicated by the number of times the user 
activates (presses) the "Like" control 42g while the com- 
position is playing. For example, if the user activates 
(presses) the "Like" control multiple times while a compo- 
sition is playing, the user rating for that composition (and 
the frequency that the composition is played) would be 
significantly increased. Alternatively, the "Play" control 
42d may be used (instead of the separate "Like" control) 
to indicate a user desire for the currently playing compo- 
sition to be played more frequently. The user may activate 
the "Play" control one or more times to indicate a desire to 
hear the currently playing composition more frequently. 
The variation/distribution in the number of multiple "Like" 
pushes typical for a given user may be used to calibrate 
the appropriate adjustment of the user's composition rat- 
ing versus number of "Like" pushes. Such calibrations may 
be adjusted over time so that the rating change associated 
with each different number of "Like" pushes, may adopt to 
each user over time. 
14 ] Similarly, a compositions rating may be increased when a 
composition "highlight" segment is playing and the user 
hits the "Play" control 42d, in-order to immediately hear 



the full composition. 
[0115] Although, a "dislike" control (or voice command) may be 
similarly utilized to indicate a negative feedback, it may 
not be needed since use of the "forward" (skip) control 
while a composition is playing, is itself a sufficient indica- 
tor of "dislike". 

[01 1 6] Even if the user does not provide any feedback on a com- 
position during a playback, the user's rating may be auto- 
matically adjusted lower (or higher) based on an estimated 
change in likeability as a function of the number of times 
heard by the user. Figure 7a show examples of likeability 
of a composition as a function of "number of times 
heard". The data illustrated by these curves may be gen- 
erated based upon the aggregate feedback to the compo- 
sition from other users considered similar to the user. 
Curve J in figure 7a, is an example of a high initial like- 
ability for many playbacks followed by an eventual decline 
in likeability. Curve K in figure 7a, is an example of 
medium high initial likeability followed by an initial in- 
crease in likeability with times played, then followed by an 
eventual decline in likeability from the peak likeability. Al- 
though curves are shown for illustration purposes, the ac- 
tual embodiment, may utilize look-up tables, databases, 



functions, equations, etc. 

[° 117 ] If the user has had a lot of recent forwards (skips) over 
prior favorite compositions, the favorites-new setting 41 
may be automatically adjusted more towards the "new" 
mode so that the user is exposed to a larger number of 
new compositions. In this case, the favorites-new indica- 
tor (41 in figure 4) may be automatically adjusted to be 
closer to the "new" position. 

[0118] By utilizing the normal user control actions as feedback 
on each currently playing composition, the users rating 
automatically adopts to the user's evolving preferences 
and tastes over time without requiring special actions by 
the user to specifically rate compositions. A user's com- 
position rating may be re-adjusted each time a composi- 
tion is played or selected, so the rating adapts gradually 
and automatically. User feedback on each composition 
while it is playing occurs automatically based on the user's 
normal control actions. 

[0119] The user does not need to know the artist, title or any- 
thing about the composition, only whether he or she likes 
what is currently playing. The user does not need to take 
special action to rate compositions on a rating scale. The 
user also does not need to be aware of a rating number 



system (e.g., 1 to 100) or adjusting the relative number 
rating of one composition versus another and to manually 
re-adjust such ratings as the user's tastes change over 
time. The user is not required to navigate a set of win- 
dows or menus to rate the composition. The user is not 
required to manually select from a catalog of composi- 
tions in-order to create composition playlist(s). 
[0120] Figure 1 illustrates the capture of user control actions 
representing user feedback about a currently playing 
composition. "Start" 4 occurs with the "Begin composition 
Play" and the "Reset and start of the playback timer" 7. 
The playback timer records how long each composition 
has been playing. When the user control action (while the 
composition is playing) is a "Forward" pressed to skip" 3d 
(i.e., stop currently playing composition and go to next 
one), the timer may be used to determine the percentage 
of the composition that was played, which may be repre- 
sentative of the amount of user dislike for the composi- 
tion (a negative feedback). Typically, the lower the per- 
centage that a composition was played through, the 
greater the user dislike for the composition. When the 
user control action is a "Back" pressed to repeat" 3c (while 
the composition is playing or has just finished), an "Imme- 



diate repeat request" (a positive feedback) is generated for 
the composition. When the user control action is a "Like" 
pressed during play" 3b, the number of times the "Like" 
was pressed during composition playback (a positive 
feedback) is captured for the composition. If the user took 
specific action(s) to play the composition, such as "User 
requested composition to play" 3a (a positive feedback), 
the manner that the user requested play is captured. For 
example, the user may have searched his favorites to re- 
quest that the specific composition be played. When a 
complete playback has occurred 3e, a "100% played" is 
captured as user feedback. 
1 ] Note that the composition playback may be required to 
have played for at least a "Recognition Time" threshold 6 
before certain user control actions are captured. The 
"Recognition Time" threshold represents the minimum 
amount of time that a composition must have played in- 
order for a user to hear it and form an opinion. The 
threshold may be used to filter out user control actions 
that occur too soon after a composition starts playing, to 
be true feedback about the composition. When a compo- 
sition playback begins, the composition ID, date and time 
may also be captured. Note that there are many "user 



control actions during composition playback" 2 that may 
generate "User Feedback" 1. The "User Feedback" 1 is then 
"added to the User History" 7. 

[0122] Composition Sequence Generation: 

[0123] Figure 6 is a functional diagram of a real-time sequence 
generator 60. The sequence generator operates in real- 
time in-order to immediately respond to user control ac- 
tions 61 such as "forward", "back", "pause", "play". The 
sequence generator is able to automatically transition be- 
tween immediately responding to user control actions and 
automatically generating a customized sequence of com- 
positions (entertainment program) for the user. 

[0124] The sequence generator may automatically enter the cus- 
tomized program mode whenever all prior user control 
requests have been completed and the user is not cur- 
rently providing control actions to affect the composition 
sequence. 

[0125] when in the customized program mode, a primary deter- 
minate for the "ID of the next composition to be played" 
67 is the position (setting) of the "Favorites-New" control 
41. When in the favorites position, compositions are cho- 
sen based on the likeability ratings of compositions based 
in the "user's history" 64. If the user's list of favorites is 



short, then it may be necessary that new (to the user) 
compositions and highlights may be interspersed with the 
user's favorites to provide sufficient composition variety 
and to allow automatic expansion of the user's list of fa- 
vorites (or collection). 
[0126] The time between the playback of user favorites may be 
determined as a function of the "number of times heard". 
Figure 7b shows example curves of "time between plays" 
versus "number of times heard" and the psychological 
"complexity of the composition". When a composition is 
new to the user (and the user has indicated positive feed- 
back) the time between plays is shorter. Eventually, as 
user likeability decreases with familiarity, the time be- 
tween plays is increased. The user may tire of composi- 
tions with a lower psychological "complexity" more quickly 
than those with a greater psychological "complexity". The 
likeability functions may be constructed based on aggre- 
gate user feedback of users that are considered similar to 
the user. 

[0127] Alternatively, the "time between plays" may be determined 
or influenced by the ratio of "current likeability divided by 
peak likeability". As the example in figure 7c shows, the 
"time between plays" may increase as the "current like- 



ability" decreases relative to "peak likeability". A re- 
schedule queue 65 may be used to hold the user's fa- 
vorites ordered by their next playback time. 

[0128] it may also be useful to define different types of "time be- 
tween plays". First, there may be a "no more than X time 
between plays" for new compositions that the user has in- 
dicated significant positive feedback and hence wishes to 
hear frequently. Second, there may be a "at least X time or 
greater between plays" for older favorites that the user 
still likes somewhat but no longer wants to hear as often. 

[0129] Although curves are showed in figures 7a, 7b and 7c for 
illustration purposes, actual implementations may utilize 
methods such as lookup tables or equations/functions 
where the coefficients/parameters are determined by fit- 
ting to the data within an acceptable error. 

[0130] An ordered list of the locally available new compositions 

62 and an ordered list of the locally available highlights 

63 may be used to determined the order they are pre- 
sented to the user or interspersed with the user's fa- 
vorites. When the sequence generator has decided to 
playback a new composition or highlight, the next one on 
these lists is played. The selection of the compositions on 
these lists and their order on these lists may be deter- 



mined as described in the section entitled "Selection of 
New Compositions and Highlights". Only compositions for 
which the user has usage-rights and that are immediately 
available locally are included on this list. Some composi- 
tion providers may allow a certain number of free plays 
for a user in the hopes that the composition will become a 
user favorite and be purchased and added to the user's 
collection. 

[0131] The sequence generator 60 maintains a record of the 
"user history" 64 locally which is updated with all the 
user's control actions and the history of composition play- 
back. When scheduled and when network connectivity is 
available, the sequence generator 60 provides "user his- 
tory updates" 66 back to the experience provider. The up- 
date may only include new [and may exclude previously 
forwarded] user history information. 

[0132] A n example of the "user history" 64 data elements is 

shown in figure 5. Shown at the top of each column in fig- 
ure 5, are parameters that may be captured for each com- 
position the user has heard. The parameters maintained 
for each composition may include the following: 1) A 
unique "composition number (Comp #) used to identify 
each composition. 2) The user's usage-rights token for 



each composition. 3) Whether the composition is available 
locally. 4) The user's current enjoyment rating. 5) The 
user's peak enjoyment rating. 6) The number of times the 
composition was heard. 7) The play history including the 
date/time when the composition was last heard. 8) The 
target time between playbacks. 9) The user feedback his- 
tory representing the positive and negative user control 
actions related to the composition. 10) The likeability 
curves, equations or functions that apply to the composi- 
tion which may be identified by a pointer, filename or 
other identifier. 

[0133] it is preferred that the sequence generator 60 be imple- 
mented as a plug-in software module, so that continually 
improved versions may be created by the experience 
providers or sequence generator providers. 

[01 34] Using "Highlight" Segments to Introduce New Compositions: 

[0135] including highlights (i.e., composition samples) in the 
customized entertainment sequence is an optional en- 
hancement of the invention. It allows the user to more 
quickly discover pleasing compositions that are "new" to 
the user. "New" to the user means compositions that the 
user has not yet heard or is not yet sufficiently familiar 
with. This would include compositions that have been 



available for many years but the specific user has not yet 
experienced. It also includes those compositions that have 
been recently released but the specific user a limited fa- 
miliarity with. A composition may be "new" to the user 
even though was released years or decades ago. High- 
lights may be interspersed with full compositions in the 
customized entertainment sequence. New highlights are 
custom selected for each user based upon the probable 
likeability (enjoyment) as estimated from the user's history 
and profile. 

[0136] Each highlight-snippet (i.e., composition sample) is an 
approximately 10 to 20 second cut (sound segment) of a 
highly compelling part (or parts) of a composition. The 
most compelling part(s) of a composition will typically be 
manually pre-selected by an artist, expert, focus groups 
or based on aggregate user feedback. Assuming an aver- 
age composition duration of a little over 3 minutes, the 
use of highlights may increase the user's discovery of new 
music by a factor of about 10 to 20 times. The highlight- 
snippet (sound segment) may utilize a storage format 
similar to any other composition (only they are of shorter 
length). A highlight snippet may be free for a limited or 
unlimited number of plays by a user. An audio or visual 



indicator may be utilized to distinguish between a high- 
light and a full composition. 

[° 137 ] Highlights may be interspersed with user favorites and 

new compositions based upon the "favorites- new" control 
(slider) 41 setting. Highlights may be interspersed more 
frequently, the closer the "favorites- new" control 41 is to 
the "new" position. 

[0138] | n one variation of the invention, when the slider 41 is in 
an extreme newness position (uppermost position), the 
device will enter the highlights-mode where the user will 
hear a sequence of composition highlights so that the 
user is exposed to a larger number of compositions in a 
shorter period of time. The highlights-mode allows each 
user to discover new pleasing music and to expand their 
collection of compositions at a higher rate. 

[0139] Typical user control actions may be captured as user his- 
tory (feedback) while each highlight is being played. This 
may include skipping ("Forward") when the user dislikes 
the highlight (indicating negative feedback) or jumping 
backward ("Back") if the user wishes to hear the highlight 
again (indicating positive feedback) or activating 
(pressing) the "like" control (indicating positive feedback). 
While the highlight is playing, the user may activate 



(press) the "Play" control to immediately hear the full 
composition (also indicating positive feedback). After the 
full composition has finished (and the user has not pro- 
vided other control actions), the "highlights" mode may 
resume playing other highlights. 

[0140] when the user indicates sufficient positive feedback, while 
a highlight is playing, the composition may be added to 
the user's list of favorites or potential favorites. When the 
user indicates sufficient negative feedback while a high- 
light is playing (such as forwarding past it), that highlight 
(and "similar type" highlights) may be less likely to be 
presented to the user. If the user does not provide any 
feedback or a weak feedback, while a highlight is playing, 
that highlight may be presented to the user for re- 
consideration (and user feedback) at a later time. 

[° 141 ] Since the user might activate a control in error, the user 
ratings of a composition should not be excessively ef- 
fected by a single user control action. Rather the user rat- 
ings for a composition may be gradually changed based 
upon feedback from multiple exposures to the composi- 
tion over a period of time. For example, it may take sev- 
eral playbacks of a composition over a extensive period of 
time, in which a "Forward" (skip) was consistently acti- 



vated early during the composition playback (and there 
was no other positive feedback), in-order for the user's 
rating of that composition to become so negative that it 
would not be presented to the user again. 

[0142] when the user's list of favorites is too small to generate a 
sequence with an acceptable time between replays of the 
user's favorites, the sequence generator may intersperse 
more new compositions and/or highlights between the 
user favorites. In this manner, a user's list or collection of 
favorites may be naturally expanded, when required, 
without requiring any special user actions to search for 
and locate the new compositions. 

[0143] when the sequence generator is in the favorites mode and 
the user appears to be disliking and forwarding over much 
of the music, the device may recommend that the user 
move toward the "new" position on the "Favorites-New" 
slider 41. Alternatively, the slider 41 may be automatically 
moved toward the new position so the user will be ex- 
posed to more new compositions that are likely to be 
pleasing to the user. In addition, an increased number of 
new highlights may be automatically interspersed by the 
sequence generator. 

[0144] The user device may include a mechanism for the user to 



approve the acquisition or purchase of a new composi- 
tion^) or the usage-rights for a new composition(s). For 
example, the device display may display information 
about the new composition such as its purchase price and 
purchase terms while the composition or its highlight is 
playing. Or such information may be communicated to the 
user by audio prior to or following the playback of the 
composition or highlight. A sale or bargain price may be 
offered to the user. To confirm a purchase, the user may 
take control action such as activating a certain control or 
perhaps speaking a certain word or phrase. Of course, 
some purchase plans may not require approval of each 
purchase. 

[01 45] Selection of New Compositions and Highlights: 

[0146] a process for generating a "recommended list of new 

compositions and/or highlights for the user" 87 which is 
customized for each user is shown in figure 8. The rec- 
ommendation generator 82 for new compositions and 
highlights may utilize the user's history 66 and common 
likeability indexes (composition mapping indexes) 80a & 
80b, in-order to provide a customized experience for 
each user. The "recommendation list" 87 for each user 
may also be dependent on the "Meta-catalog of composi- 



tions and highlights available to the user" 85. The meta- 
catalog available to a given user may not include all the 
compositions available in the world. The meta-catalog 85 
available to a user may be limited due to considerations 
that may include: the user's subscription plan or user pur- 
chase limitations or limitations imposed by an particular 
experience provider. 
[0147] a common likeability index may contain a mapping of "if 
liked composition(s)" then "also liked compositions". An 
example of simple one-to-one likeability index of compo- 
sitions (i.e., composition mapping index 80) is shown in 
figure 9. For each "if liked composition #" shown in col- 
umn 1 a list of "also liked composition #'s" are listed in 
column 2. For example, if composition 854108 is liked 
then compositions 883491, 103293, and 527177 will 
probably also be liked. This mapping may be determined 
by some combination of experts, focus groups, or by an 
analysis of the aggregate feedback of all users. If the ag- 
gregate feedback of all users is employed, then the index 
may keep track of additional parameters such as "# Users 
mapped", "# users liking both" and "% users liking both". 
The aggregate "likeability" mapping analysis may be 
based on either "current likeability" or "peak likeability" 



values for the composition. 

[0148] An example of a more complex many-to-one likeability 
index (mapping) of compositions is shown in figure 10. 
For each group of "n" (= 3 in figure 10) "if liked composi- 
tion #" shown in columns 1 to 3, a list of "also liked com- 
position #'s" are listed in column 4. For example, if com- 
positions 854108, 883491 and 107389 are liked, then 
compositions 230845, 632952 and 428503 will probably 
also be liked. To reduce searching, the indexes may be 
maintained in numerical order and/or with numerical 
cross-references. 

[0149] when a new composition is first released it may be con- 
sidered to be "untested" since no aggregate user history is 
available. "Expert and focus group opinions" 86 may be 
used to perform an initial "untested likeability analysis" 
81b. Based on the initial index (mapping) 80b, the new 
composition may be sampled (possibly as highlights) to a 
limited number of users in-order to obtain "aggregate 
user feedback" 84a from enough users to perform a "com- 
mon likeability index analysis" 81a and create an aggre- 
gate composition mapping index 80a. Once the "aggre- 
gate likeability analysis" 81a is based upon a sufficient 
amount of "aggregate user feedback" 84a (i.e., exceeds an 



"aggregate feedback threshold" 83b), the aggregate index 
(mapping) 80a may then replace the initial expert gener- 
ated likeability index 80b. In this way, untested new com- 
positions are not widely distributed to new users until an 
initial aggregate feedback establishes their likeability with 
a smaller number of users. In this manner, a greater vari- 
ety of new compositions may be each initially tested with 
a small subset of all users without burdening any one user 
with many untested compositions. Alternatively, "cutting 
edge" users may be offered the option of subscribing or 
activating a special "untested" mode and to be exposed to 
a greater number of untested compositions. A "rate of 
untested compositions" parameter 83b may be used to 
control each user's preferred amount of exposure to 
"untested" compositions and/or highlights. 
[0150] a list of recommended new highlights and/or composi- 
tions for each user may be generated in advance at the 
experience providers network location. The list is ranked 
and ordered based on compositions that are most likely to 
be pleasing to the user. Depending on the rankings and 
quantity of highlights previously downloaded and still un- 
used at the user's device, some or all of the highlights in 
the revised highlight list are downloaded into the user's 



device so they are immediately available if requested by 
user action. The full composition may also be down 
loaded at the same time as the highlight so it is immedi- 
ately available if the user requests the full composition be 
played upon hearing the highlight. 

[0151] Another optional enhancement, is to additionally con- 
strain the recommended new compositions and highlights 
based on "user content restrictions" 83a. Each composi- 
tion may be pre-tagged by restriction categories, by the 
content providers or content rating providers. Restriction 
categories may be based on factors such as the user's 
age, language, violence, sex content, etc . The content re- 
strictions are settable by either the user or the user's 
guardian (through password protection), in-order to pre- 
vent the recommendation and playback of highlights/ 
compositions from undesired categories. 

[0 1 52] Composition Finder using Recognition-Snippets: 

[0153] Another optional enhancement is the composition finder 
tool to aid the user in finding a particular composition in a 
group of compositions by audio sound. Associated with 
each composition is a short recognition-snippet (sound 
segment) which has been pre-selected as the most 
quickly recognized portion of the composition. The 



recognition-snippet may be a separate sound segment 
(file) that is a few seconds long, representing a highly dis- 
tinguishable part of the composition. Alternatively, the 
recognition-snippet may be defined by start and end 
pointers into the full composition itself. The choice of the 
highly recognizable portion(s) of each composition may be 
made by the artists, experts, focus groups, or others. The 
recognition-snippet is expected to be different and 
shorter than the highlight-snippet. 

[0154] The composition finder is useful whenever the user wants 
to locate a specific composition in a group of composi- 
tions. Examples of groups of compositions where the 
composition finder may be used include: 

[0155] i) a set of user favorites ordered from most favorite to 
least favorite. 

[0156] 2) A set of recent plays ordered from most recent to least 
recent. 

[° 157 ] 3) A set of compositions by an artist (such as an album or 
collective works). The set may be ordered by highest to 
lowest estimated user likeability or another order, appro- 
priate to the user's request. 

[0158] 4) a set of compositions in a particular genre. The set may 
be ordered by highest to lowest estimated user likeability 



or another appropriate order. 

[0159] 5) a set of compositions resulting from a user initiated 
search. The search results are ordered from highest to 
lowest probability of matching the user's request. The 
search request my have been initiated by any means, in- 
cluding a user's verbal (voice) request for a specific com- 
position, where there are multiple compositions that 
match the request. 

[0160] Figure 11 is a flow diagram of one embodiment of a audio 
composition finder. Entry into the composition mode may 
occur when the user initiates control action(s) to locate a 
specific composition in a group of compositions. Referring 
to figure 11, the process begins with a list of composition 
identifiers 118. The finder begins by playing of the recog- 
nition-segment for the first entry in the ordered list of 
identifiers 110. When there is no user control action 112 
and the segment has finished playing 113, the recogni- 
tion-segment corresponding to the next entry on the or- 
dered list of identifiers is played 110. The playing of the 
recognition-segment for the following entries in the or- 
dered list, continues until there is user control action. 
When there is user control action 112, the control action 
is recorded 114 as "user history" (feedback) and may be 



associated with the composition that was playing when 
the user control action occurred. If the control action was 
"Play" 115a, then the playing of the full composition is 
begun 116 and positive feedback on the composition is 
added to the "user history". The full composition is played 
to the end, unless user control action is taken 112. If the 
user control action is "Forward" 115c, then the currently 
played segment or composition is stopped and play be- 
gins on the next segment on the ordered list 110. If the 
user control action is "Back" 115b, then the currently 
played segment or composition is stopped and play be- 
gins on the previous segment on the ordered list 111. If a 
user control action other then "Play", "Back" or "Forward" 
occurs , then the favorite finder mode may be exited and 
action appropriate to the other control action is per- 
formed 117. 

[0161] | n a more general application of the composition finder, 
the user makes a (possibly verbal) request for which sev- 
eral compositions satisfy the request criteria due to the 
ambiguity of the request. The list of compositions satisfy- 
ing the request may be ordered based on probability of 
being what the user wanted. The composition finder is 
then used to quickly find the desired composition. Many 



other uses for the composition finder may be employed 
within the scope of this invention. 
[0162] An example is the use of the composition finder to help 

the user find a specific favorite composition for immediate 
playback. Based on data in the "user's history", a list of the 
user's favorites may be ordered from currently most fa- 
vorite to least favorite. When the user activates the appro- 
priate control(s), an audio sequence of recognition-snip- 
pets, in order of most favorite to least favorite, may be 
played for the user. The user may activate the "forward" or 
"back" controls to more quickly navigate through the 
recognition-snippets. When the user hears the "snippet" 
for the desired composition, the user activates (presses) 
the "play" (or "like") control to hear it. The use of recogni- 
tion-snippets allows the user to more quickly locate the 
desired composition, especially compared with using the 
beginning of each composition which is often not as im- 
mediately distinguishable as other portions of the compo- 
sition. 

[0163] | n this manner, the user may quickly find a specific com- 
position without viewing a display or scrolling though 
window(s) of visual information. It is particularly suitable 
where user visual distractions are dangerous or undesir- 



able such as when driving an automobile or listening to 
music in the dark. 

[0164] "Capture" Mode: 

[0165] Another optional enhancement, is the "Capture" (or "Iden- 
tify") mode. This mode is used to identify a particular 
composition the user enjoys but which is being generated 
by some other external source. Examples of external 
sources include compositions heard on the radio or televi- 
sion, at a movie, in public or at a friend's house. The 
mode may be initiated when the user activates a "Capture" 
control 46 as in figure 4. When activated, a microphone 
47 in the user device coverts a portion of the external 
sound into an analog signal. An analog to digital converter 
is then used to convert the analog signal into digital 
sound samples. An analysis is performed to identify the 
particular composition so it may be presented to the user 
at a later time for feedback and possible addition to the 
user's list of favorites. The capture mode may be initiated 
by the user activating (pressing) a "capture" control 46. In 
one embodiment, the device captures a sample of the ex- 
ternal sound into its memory and then automatically for- 
wards the sample to a "composition identification func- 
tion" which is remotely located at the experience 



providers network location. The user display may option- 
ally provide a momentary indication to the user that the 
identification of the captured composition was success- 
fully completed and optionally provide information about 
the composition to the user. When the identification pro- 
cess was ambiguous, the list of possibilities may be pre- 
sented to the user via the "composition finder using 
recognition-segments". 
[° 166 ] "Share" Mode: 

[0167] Another optional enhancement, is the "share" mode/ 
capability. This allows one user to share a share list of 
composition(s) with a second user. The first user identifies 
the user ID where the share list of composition identi- 
fiers) is to be sent to. The share list is forwarded across a 
network such as the internet to the second user's profile. 
If the second user accepts the share list from the first 
user, those compositions which are "new to the user", may 
be added to the second user's recommended new compo- 
sitions and highlights list 87. Later, highlights or the full 
compositions are presented to the second user. Those 
highlights or compositions then receiving favorable feed- 
back are then added to second user's favorites list (user 
history). 



[0168] | n an alternative embodiment, the share list is transferred 
directly between user devices via electromagnetic or 
sound waves (for example, RF or IR transmission such as 
Bluetooth) with or without the use of a network. The sec- 
ond user's device then automatically forwards the share 
list to their experience provider for possible incorporation 
into the second user's "recommended new compositions 
and highlights list" 87. 

[01 69] jj ser Channels, Moods and/ or Categories: 

[0170] The device may optionally allow the user to create a plu- 
rality of uniquely defined channels, each for a different 
user mood, activity, event or category of music. For ex- 
ample, the user may desire a dinner music channel, dance 
music channel, commuting channel, romantic channel, 
etc. As with a normal radio, at power-on the device may 
start playing at the last channel the user was at. 

[0171] The user's channels may be accessed via the "My" chan- 
nels control 43a shown in figure 4. In one embodiment, 
the favorite (most used) user channel starts playing when 
the "My" channels control is activated (pushed). The re- 
maining user channels are ordered from most used to 
least used and are reached using the channel "up" 43c and 
"down" 43d controls. The list may be wrapped around so 



pressing "up" 43c when at "most used" channel will wrap 
to the "least used" channel. Pressing "down" 43d at the 
"least used" channel may wrap to the "most used" chan- 
nel. If the user has only defined one channel, then the 
"up" and "down" controls wrap on the single channel and 
hence do not cause a channel change. As shown in figure 
4, the display 40 may indicate the name of the current 
user channel playing and how many other user channels 
are available. The display may include a channel slider 44 
to indicate where the channel is relative to the user's fa- 
vorite channel (based on the user's history of channel ac- 
tivity and feedback). A slider 44 position at the top may 
be used to indicate the user's most favorite channel. A 
slider 44 position at the bottom may be used to indicate 
the user's least favorite channel. The size of the slider rel- 
ative to the slider range may be used to provide an indi- 
cation of the size of a channel relative to the total number 
of user channels. For example, if there are 5 user chan- 
nels then the size of the slider is displayed as one fifth of 
the slider range. 

[0172] The user may begin the creation of a new user channel by 
activating the "Create" channel control 43b. The user now 
has access to a plurality of "starting" channels (possibly 



100's) via the channel "up" 43c and "down" 43d controls. 
In one embodiment, each "starting" channel my be playing 
"highlights" representing a different mood or category of 
music. The ordering of the "highlights" channels may be 
based on the user's history (and the aggregate experience 
of similar users), so that the most likely pleasing "high- 
light" channels for each user, require the fewest pushes of 
the channel "up" 43c and "down" 43d controls. The user 
provides feedback about each channel by the amount of 
time spent at a channel. The user also provides feedback 
on each "highlight" while it is playing via the "forward" 
42c, "back"42f, "like" 42g and "play" 42d controls. All the 
feedback history is retained for use the next time the "cre- 
ate channel" mode is entered. Once the user has gener- 
ated a threshold amount of positive feedback on a "high- 
light" channel, a new user channel may be automatically 
added to the user's channel list. Until the user has pro- 
vided a second higher threshold of feedback, the new 
channel may tend to provide a larger number of highlights 
in-order to allow the user to more quickly tune the chan- 
nel to the user's preferences. 
[0173] As another optional capability, the user would be able to 
define a playback by artist, album, title, time period, mu- 



sical category, etc or search a catalog based on such pa- 
rameters. 

[0174] Methods for deleting, splitting and merging channels may 
be incorporated into the user device. 

[0175] Different "starting" channels, may be created by the same 
or by different experience providers but all channels 
would utilize a single, common collection of user usage- 
rights tokens. 

[0 1 76] Metwork Strategies: 

[° 177 ] It is expected that each user will have multiple devices 

that need to be synchronized such that any changes to the 
user's history and user's collection (i.e., the user's library 
of compositions) at any one device is also automatically 
made available, in a timely manner, to all the other de- 
vices a user will be using. For example, any changes made 
in the automobile on the way home will be immediately 
available, in the ideal, to devices in the user's home. 

[0178] | n one embodiment, each user device would be capable of 
establishing two way communication in-order to interact 
with the experience provider over a wireless or wired con- 
nection to a network such as the internet. 

[0179] when the user's device has sufficient storage, the user's 
favorites may be stored locally and the general network 



strategy is to download the most likely needed composi- 
tions and highlights well in advance of actual need by the 
user's device. Having storage in each device is more ac- 
commodating to poor quality, intermittent, or missing 
network connections. 
[0180] when a local device has sufficient local storage, the net- 
work interface may be managed to minimize communica- 
tion costs. For example, the largest downloads and up- 
loads may be scheduled during those times (of the day or 
night or week) when the communication costs are lower. 
For example, downloads of new compositions and high- 
lights may occur, automatically without user action, in the 
middle of the night and then stored within each device for 
possible use during the following days. More information 
may be downloaded than is typically expected to be 
needed, just so it will be available if needed. Since the 
typical user's tastes change slowly over a period of days, 
the locally stored library of compositions and snippets will 
be fairly up-to-date but the sequence of playbacks when 
switching devices (e.g., car to house) may be less then 
ideal, since the most recent user history would not be ex- 
changed until later that night. If desired, the less data in- 
tensive user history/feedback may be communicated more 



frequently, while the more data intensive downloads are 
restricted to lower cost communication times. 
[0181] Another alternative is to broadcast and/or multicast the 
data intensive information (compositions and highlights) 
to multiple users simultaneously over the network. Prior 
to the broadcast or multicast, each user device receives an 
update on what new compositions and highlights that 
user needs. The user devices then monitor the broadcast 
or multicast, and save the appropriate data the user is ex- 
pected to need. 

[0182] u ser devices may also network directly with each other or 
over a network to pass update information. In remote lo- 
cations where networked access is not available, the up- 
date to the remote devices may be handled by a portable 
device carried from a networked area into the remote 
area. The portable device then networks with the remote 
devices to update them. Similarly, after leaving the remote 
area and re-establishing a network connection, the 
portable device may update the depository with the user 
feedback that occurred in the remote area. In this case, 
the user's devices may directly interact to share informa- 
tion when they are within communication range with each 
other. Such direct communication may be accomplished 



by IR or RF means such as WiFi or Bluetooth. 
[0183] The invention may also be embodied via streaming over a 
network connection such as the internet. With streaming, 
the personalized sequence is generated at the experience 
provider's location on the network (e.g., internet) and for- 
warded, wired and/or wirelessly, to the user's device as a 
stream of packets. The user's device is simplified since it 
must only convert the packets into the entertainment se- 
quence (e.g., sound sequence) and send the user's feed- 
back back across the network to the experience provider. 
Streaming reduces the needed amount of local storage 
and local processing in the user's device. Usually a small 
local memory (such as a FIFO or double buffer) is used in 
the local device to provide a continuous sound stream on 
the output side, despite fluctuations in the receipt and 
processing of packets across the network connection. A 
disadvantage of streaming is that a virtually continuous 
interactive network connection at an effective bandwidth 
must be available. Another major disadvantage is that the 
network connection must have an acceptably low interac- 
tive latency so the experience provider's streaming source 
may quickly adjust to the user's feedback and control in- 
puts (such as the "Forward" and "Back" controls). The need 



for a higher quality network connection to be continuously 
available, may make streaming a less desirable alternative. 

[0 1 84] Business Models: 

[0185] This invention is capable of simultaneously supporting 
many different schemes for generating revenue and/or 
royalties for the experience providers, network providers, 
composition providers, composition creators and artistic 
performers. The schemes include: 

[0186] i) Fee for each composition each time it is played. 

[0187] 2) One time fee for unlimited play of a composition by the 
user. 

[0188] 3) a fee per minute or hour of experience provided to the 
user. 

[0189] 4) a flat fee per month independent of the actual user us- 
age. 

[0190] 5) Advertisement supported, where the user must listen to 
and possibly interact to a certain amount of ad time per a 
predefined amount of non-ad user time. 

[0191] 6) a certain number of free plays followed by some fee for 
play. 

[0192] 7) Number of user devices. 

[0193] 3) Number of user devices simultaneously active. 



[0194] 9) Amount of data transferred across the network. 

[0195] io) Various combinations of the above. 

[0196] The experience providers may simultaneously manage 
each of these billing schemes for different groups of 
users, so the billing scheme may be customized for each 
user. The history of the aggregate usage for each compo- 
sition may also be used to determine royalties for the 
composition creators, composition owners and other ser- 
vice providers. 

[0197] The experience provider does not need to store an indi- 
vidual library of compositions for each user. The actual 
compositions may be stored in a common library that is 
shared by all users and accessed based upon a user pro- 
file maintained for each user. The amount of access band- 
width provided for each composition may be adjusted to 
match aggregate user demand. For example, a currently 
popular composition that is being downloaded by many 
users, may be made available from many servers across 
the network in-order to meet the demand. While a less 
popular composition many be made available from signif- 
icantly fewer servers on the network. 

[0198] As an optional enhancement, the user may be allowed to 



use the "forward" control to skip any offensive or un- 
wanted advertisement (ad). Alternative ads are then pre- 
sented to the user until the required user ad time is satis- 
fied. When the user wants additional information about 
the product in an ad, the user activates (presses) the "like" 
control. Additional information is then presented. The 
user may also activate the "back" control to hear an ad 
again in-order to repeat needed information such as a 
phone number or address. The user's account is credited 
for the additional ad time heard. The user's use of the "for- 
ward" and "back" controls during ads may be used to 
more closely target future ads to the user. 

[0199] This invention may accommodate various encryption 

schemes in-order to protect from piracy or user attempts 
to interfere with the collection of billing information. 

[0200] initial System Customization to the User: 

[0201] jo more efficiently perform customization of the system 
for each user, a large display with an interactive user in- 
terface may be utilized across a network during the initial 
user customization process. The user may answer forms 
on the user's interests, hobbies, categories or products of 
interest, etc. 

[0202] This may include the establish of methods for confirming 



the user's identity at the start of future device sessions. 
This may include capturing sound to be used for voice 
recognition of the user's name or other specific words, 
biometrics measurements of the user such as fingerprint 
on the start control, or camera imaging of the user's face. 

[0203] The user may also indicate initial preferences for adver- 
tisement categories. In this mode, the user may be pre- 
sented with different product categories and product 
types for which the user may use the "Like" control to in- 
dicate relative interest in. 

[0204] The user may also wish to customize of the type and fre- 
quency of news, weather, traffic, etc based on the day of 
week, time of day, location of user, etc. 

[0205] The initial preferences the user provides are only the 

starting point. User feedback, indicated by normal user 
control actions, is utilized to continuously adopt the en- 
tertainment sequence more uniquely for each individual 
user. 

[0206] User History Timeline: 

[0207] | n another optional extension, the actual timeline of a 
user's history of feedback and favorites may be made 
available to the user via an interactive interface and dis- 
play. As an example, the user would be able to review 



what was listened to at any earlier time period or time in- 
terval, for example a particular day, week or month during 
the college years. Such a history review mode or capability 
may not be needed for most types of user devices. 

[0208] jj ser Provided Compositions: 

[0209] | n another optional extension, the user would have the 

capability of providing compositions and highlights to the 
system. This is useful in cases where the user may have 
created their own compositions or acquired them locally 
or where the experience provider does not have access to 
certain compositions. 

[0210] Additional Applications of the Invention: 

[° 211 ] In order to more clearly illustrate functionality, portions of 
the preceding discussion were oriented toward a playback 
device with a manually controlled interface, however the 
invention may utilize any type of user interface including 
voice controlled. 

[° 212 ] In order to more clearly illustrate functionality, portions of 
the foregoing discussion were described in terms of music 
and/or music videos, however this invention is more gen- 
erally useful for the generation of any type of personal- 
ized entertainment experience that is customized for each 



user. The entertainment experience that is personalized 
for each user may be comprised of a sequence of any type 
of entertainment compositions including music, music 
videos, short films, movies, video programs, audio ver- 
sions of books, talks, speeches, voice content, lectures, 
etc. 



